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I claim: 



1 . \ A method of operating upon digital data comprising the steps of: 
partitioning the digital data into a plurality of blocks; 

reating a plurality of first threads, such that each first thread includes at least one 
of the plurality of blocks; and 

operating upon each of the plurality of first threads to obtain a plurality of 
compressed firs^ threads, each compressed first thread including at least one compressed 
block of digital ■ 

2. A method according to claim 1 wherein the step of operating upon each of the 
first threads performs lossless compression. 

3. A method according to oJaim 1 wherein the step of operating upon each of the 
first threads independently operates upon each of the plurality of first threads. 

4. A method according to claim 1 wherein at least certain ones of the first threads 
are independently operated upon in paralle 



5. A method according to claim 4 wherein, duiting the step of operating, at least two 
different compression algorithms are used to independently operate upon different first 
threads. 



28 



ET-001 

fcTreppid CONFIDENTIAL 

6. \ A method according to claim 1 further comprising the step of combining the 
plurality of compressed first threads to obtain digitally compressed data. 

7. A method according to claim 1 wherein the step of creating the plurality of first 
threads includes the step of associating each of the plurality of blocks of digital data with 
one of the plurality of first threads such that blocks within each of the plurality of first 
threads share certain common compression characteristics. 

8. A method according to claim 7 further including the step of predicting an 
estimated compression time and estimated compression amount for each block. 

9. A method according toVlaim 8 wherein the step of creating the plurality of first 
threads also uses estimated compression time and estimated compression amount to 
determine which blocks should be associated with the same first thread. 

10. A method according to claim 8 wherein the estimated compression time and 
estimated compression amount are made based upon a selected compression algorithm, 
and wherein the step of predicting includes tW step of determining whether a proposed 
estimated completion time that is based upon erne of the compression algorithms available 
for selection will allow for a desired compression^ amount to be achieved within a desired 
compression time for the digital data. \ 
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1 1\ A method according to claim 1 wherein the step of creating each of the plurality 
of frrst threads uses a data type of each of the plurality of blocks so that each of the first 
threaate contains blocks which have a similar data type. 

12. A method according to claim 1 1 wherein the data type is determined according to 
header information related to each block. 

13. A method according to claim 1 1 where the data type is determined by comparing 
the block data to various predetermined data patterns. 

14. A method according to claim 1 further including the step of predicting an 
estimated compression time and estimated compression amount for each block. 

15. A method according to claim 14 wherein the step of creating the plurality of first 
threads uses estimated compression time and estimated compression amount to determine 
which blocks should be associateoywith the same first thread. 

16. A method according to claim 1 wherein the step of partitioning data includes the 
step of determining a size of each of the plurality of blocks taking data type of each block 
into account. \ 

17. A method according to claim 1 further including the steps of: 

operating upon each of the compressed fitst threads to eliminate each of the 
compressed first threads and retain the compressed first blocks; 
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creating a plurality of second threads, such that each second thread includes at 
least one of the plurality of compressed first blocks; and 

operating upon each of the plurality of second threads to obtain a plurality of 
compressed second threads, each compressed second thread including at least one 
compressed second block of digital data. 

18. A method according to claim 17 wherein the step of operating upon each of the 
second threads independently operates upon each of the plurality of second threads. 

19. A method according to claim 17 wherein at least certain ones of the second 
threads are independently opiated upon in parallel. 

20. A method according to claini 17 wherein, during the step of operating upon each 
of the plurality of second threads, the same compression algorithm used to operate upon 
each block is also used to operate upon the corresponding compressed block. 

21 . A method according to claim 17 furth^comprising the step of combining the 
plurality of compressed second threads to obtaimdigitally compressed data. 

22. A method according to claim 1 7 wherein the\step of creating the plurality of 
second threads includes the step of associating each oftthe plurality of compressed first 
blocks with one of the plurality of second threads such tmat compressed first blocks 
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within each of the plurality of second threads share certain common compression 
characteristics. 

23. A method according to claim 22 wherein each of the second threads contains 
compressed first blocks that were created from the same first thread. 

24. A method according to claim 23 wherein the number of second threads is greater 
than the number ofyfirst threads. 

25. A method according to claim 22 wherein compressed first blocks that were within 
the one of the first threads are used to form two distinct second threads. 

26.. A method according to cmim 17 wherein the step of operating upon each of the 
plurality of first threads also results\n obtaining a plurality of first metadata sets, each 
first metadata set including portions oi\compressed first blocks which are determined to 
possibly have redundancies disposed therein. 

27. A method according to claim 26 wherein the step of operating upon each of the 
first threads will maintain for each thread a pattern of data in an initial compressed first 
block that corresponds to a first metadata pattern, Wh of the different first metadata 
patterns for each first thread combining to result in tft£ first metadata set for that first 
thread. 
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28. A method according to claim 27 wherein the pattern of data in the initial 
compressed first block is maintained during subsequent steps. 

29. A method according to claim 17 wherein each first thread has an associated first 
metadata set. 

30. A method, according to claim 26 wherein the step of creating the plurality of 
second threads includes the steps of: 

determining which compressed first blocks should be associated with the same 
second thread; and \ 

using the first metadata sets to eliminate redundancies in some of the compressed 
first blocks associated with at l^ast some of the second threads. 

31. A method according to claim\30 wherein the step of operating upon each of the 
plurality of second threads also results m obtaining a plurality of second metadata sets, 
each second metadata set including portions of compressed second blocks which are 
determined to possibly have redundancies disposed therein. 

32. A method according to claim 31 wherein\he second metadata set is a subset of 
the first metadata set. ' \ 

33. A method according to claim 26 wherein: \ 
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\ the step of operating upon each of the first threads will maintain for each thread a 
pattern of data in an initial compressed first block that corresponds to a first metadata 
pattern^ each of the different first metadata patterns for each first thread combining to 
result in the first metadata set for that first thread; 

the step of using the first metadata sets to eliminate redundancies in some of the 
compressed firs\blocks associated with at least some of the second threads maintains the 
pattern of data in the initial compressed first block and eliminates the pattern of data in a 
subsequently compressed first block. 

34. A method according to claim 33 wherein, during the step of using the first 
metadata sets to eliminate redundancies in some of the compressed first blocks associated 
with at least some of the second threads, the pattern of data in the subsequently 
compressed first block is replaced wim a pointer and an operation designator, thereby 
obtaining a plurality of compressed and Veduced first blocks in each second thread. 

35. A method according to claim 34 wherein, during the step of operating upon each 
of the plurality of second threads, the same compression algorithm used to operate upon 
each block is also used to operate upon the corresponding compressed and reduced first 
block to thereby obtain the compressed second blocksX 

36. A method according to claim 35 wherein the operation designator identifies an 
operation used to eliminate redundancies in the first compressed data blocks, the 
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)eration being one of an equal to comparison operation, a greater than or equal to 
comparison, and a less than or equal to comparison. 

37. \^ method according to claim 36 wherein, during the step of operating upon each 
of the plurality of second threads, the comparison operation selected is adaptively 
determined. 
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38. A method according to claim 37 wherein the adaptive determination is made 
based upon the patterr^of the compressed blocks as compared to representative file type 
patterns. 
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39. A method of operating\ipon digital data comprising the steps of: 
compressing the digital data usingmultiple passes of a predetermined compression 
algorithm to obtain compressed digital data; and 

decompressing the compressed^igital data using a single pass of a corresponding 
decompression algorithm to obtain the digital data. 
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40. An apparatus for operating upon digitaPdata comprising the steps of: 
means for compressing the digital data using mulfmle passes of a predetermined 
compression algorithm to obtain compressed digitalMata; and 
means for decompressing the compressed digital data \sing a single pass of a 
corresponding decompression algorithm to obtain the digital data. 
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\l . An apparatus according to claim 40 wherein the means for compressing includes: 
an interface controller; and 
a compression engine. 

42. An apparatus according to claim 41 wherein the search engine comprises a single 
central processing unit. 

43. An apparatus according to claim 41 wherein the search engine comprises a plurality 
of central processing units. 

44. An apparatus according\p claim 43 wherein each of the plurality of central 
processing units operate upbn different threads. 
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45. An apparatus according to claim 44 wherein the plurality of central processing units 
comprise a plurality of digital signal\processors. 
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46. A method of allowing a plurality of compression systems to operate more efficiently 
comprising the steps of: 

obtaining metadata representative of patterns in first digital data obtained from the 
compression of the first digital data in a first compression system; and 

distributing the metadata to the at least a seconavcompression system so that the 
second compression system can use the metadata to compress second digital data which 
the second compression system needs to compress. 



